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Bayes  and  Equivariant  Estimators  of  the  Variance  of  a Finite  Population 


By 

S.  Zacks  and  H.  Solomon 


0.  Introduction. 

Let  x^, . . . ,x^  be  the  values  of  a variable  x that  measures  a 
characteristic  in  a finite  population  of  N elements.  Let 

(0.1) 


.1  } 2 _ 1 H , ,2 

1=1  1-1 


be  the  population  mean  and  variance  of  the  measurements.  In  the  present 

2 

paper  the  problem  of  estimating  crN  on  the  basis  of  a sample  , 

2 < n < N,  from  the  population  is  studied.  The  commonly  used  estimator 

£2  1 ^ — 2 i ^ 

is  the  sample  variance  cr  = — T (X.  -X  ) , -where  X = — S X.  is  the 

n n-1  .*-»  l n n n l 

i=l  i=l 

sample  mean.  It  is  well  known  that  cr  is  an  unbiased  estimator  of  zrrr  <jc 

n N-1 


under  simple  random  sampling. 


£2 


In  the  present  study  the  "unbiased"  estimator  cr  is  replaced  by 
/*2  1 n - 2 11 

nn  = — jT  (Xi-X  )-,  which  is  called  the  "classical”  estimator.  The  two 
i=l 

estimators  are  nearly  equivalent  if  the  sample  size  is  not  trivially  small. 

2 

The  "classical"  estimator  does  not  utilize  any  prior  information  on  cr  that 
may  be  often  available.  There  are  many  examples  of  repetitive  sampling 
surveys,  in  agricultural  or  industrial  areas,  in  which  good  information  is 
available  on  the  distribution  of  the  seasonal  or  yearly  yield  (production) 
of  a certain  commodity.  Samples  may  be  taken  during  the  season  to  observe 
the  distribution  of  related  characteristics  that  may  improve  the  forecasting 
of  a population  value.  Estimates  of  the  variance  in  the  population  could  be 
adjusted  adaptively  in  order  to  imporve  the  prediction  (confidence)  intervals 
for  population  parameters. 
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In  this  paper  we  show  how  such  prior  information  on  the  mean  and 
variance  of  the  population  can  be  utilized  to  adjust  the  "classical.'' 
estimator.  Specifically,  by  utilizing  the  special  structure  of  the  sample 
survey  theoretical  model  and  of  the  likelihood  function  we  derive  the 
general  form  of  Bayes  and  Bayes  Equi variant  estimators.  It  is  shown 
that  for  any  prior  distribution,  H,  of  independent  identically  distri- 
buted variables  x^ ,x^,  having  a prior  mean  pQ  and  prior  variance 

<Tq,  the  Bayes  estimator  of  cr  fox  squared-error  loss  is  (approximately) 


(0.2) 


A4  - K + & - !>t*o  * § (W*!  • 


Estimator  (0.2)  does  not  depend  on  the  sampling  procedure.  This  Bayes 
estimator  is  a weighted  average  of  the  "classical"  estimator,  o^,  based  on 
the  observed  sample  and  the  Bayes  estimator  of  the  "within"  variance  in  the 
unobserved  portion  of  the  population  and  the  estimator  of  the  variance 
between  the  means  of  the  observed  and  unobserved  portions  of  the  population. 

The  estimator  (0.2)  could  well  be  found  very  meaningful  and  good  also  in  a non- 

p 

Bayesian  sense  by  considering  and  cr0  as  proper  estimates  (or  quesses)  of 

the  mean  and  variance  of  the  unobserved  part  of  the  population. 

? 

Equivariant  estimators  of  the  variance  o are  considered  with  respect 

l'l 


to  the  group  jfc)  of  real  affine  transformations  on  the  parameter  space  V 


(N) 


of  (x^,...,x^).  It  is  shown  that  every  equivariant  estimator  of  cr^  can  be 

p 

expressed  in  the  general  form  ant()£n)>  where  i|r(u  ) is  a proper  function 
of  the  maximal  invariant  statistic,  which  is  the  vector  of  standardized 
sample  values.  Bayes  equivariant  estimators  are  studied,  with  respect  to 
the  quadratic  loss  function  I,(cr‘n\(r (u^ ):*j, ) - (&^\Jf (u^)-^)^/^.  In  contrast 


O 


to  the  case  of  determining  Bayes  estimators,  the  form  of  the  Bayes  equivariant 
estimator  depends  strongly  on  the  particular  prior  distribution  specified 
for  x^, ...,x^.  For  example,  it  is  shown  that 


(0.3) 


a2  n , r\  \ 
°n  n-3  * 


is  the  Bayes  equivariant  estimator  for  prior  normal  i.i.d.  variables, 
regardless  of  their  prior  mean  and  variance.  The  above  formula  (0.3) 
is  relatively  simple.  It  depends  only  on  u and  does  not  depend  on 
u . This  is  not  always  the  case,  as  shown  by  Zacks  [l6]  in  the  case  of 
exponentially  distributed  i.i.d.  variates. 


In  Section  1 we  introduce  the  sample  survey  model  and  discuss  sample 
statistics  and  likelihood  functions.  The  Bayesian  approach  extending  the 
sample  survey  model  is  discussed  in  Section  2.  Sections  3 and  4 define  and 
analyze  equivariant  estimators,  Bayesian  concepts  and  loss  functions. 


Bayesian  measures  of  relative  efficiency  are  introduced  in  Section  5* 

We  provide  a numerical  example  in  which  fifty  populations  of  size  N = 100 

\ 

were  simulated  from  an  exponential  distribution.  From  each  such  popula- 

a2  2 

tion  a sample  of  size  n = 10  was  drawn  and  the  estimators  ct  and  a_ 

n x5 

were  computed.  It  is  interesting  to  observe  the  extent  to  vrhich  the 

a2  /»2 

Bayes  estimator  <x_  is  more  effective  than  the  classical  estimator  cr 
B n 

in  small  samples.  Estimate  of  their  Bayes  relative  efficiency  is  provided 


in  that  example.  General  efficiency  analysis  is  provided  for  prior  normal 
distributions.  It  is  shown  that  the  classical  estimator  is  considerably 


less  efficient  than  the  Bayes  estimator.  Some  sensitivity  analysis  is 


performed  to  study  the  effects  of  erroneous  prior  parameters  on  the 


relative  efficiency. 
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There  are  only  a few  published  papers  on  the  Bayesian  estimation  of  the 


variance  of  a finite  population.  Liu  [9]  considered  unbiased  estimators 
2 

of  o-jj  under  various  possible  sampling  designs.  Since  the  sampling 
variance  of  these  estimators  depends  on  the  population  values  x^,  ...,Xjj, 
Liu  considered  the  Bayes  risk  of  these  estimators.  He  derived  a lower 
bound  to  the  Bayes  risk  function  and  thus  showed  the  optimality  of  the 
Horwitz-Thompson  type  estimator,  under  certain  conditions.  We  remark 
that  Liu's  study  is  not  really  a Bayesian  study,  since  proper  Bayes 
estimators  are  independent  of  the  sampling  design  and  are  generally 
not  unbiased.  Royall  [10],  [11]  and  Royall  and  Cumberland  [12]  studied 
the  problem  of  developing  confidence  intervals  of  the  population 
variance  by  regression  estimates.  We  cannot  compare  their  results 
with  ours  since  the  problems  are  different  and  so  are  the  approaches. 


2.  Foundations. 

Consider  a finite  population  of  size  N whose  units  have  values 

(real  finite)  x^,  ...,Xjj.  According  to  the  modern  theory  of  sampling 

surveys  (see  Godambe  [5*6,7],  Basu  [2]  and  others)  the  population  vector 

3^  = (x^..^)  is  considered  a parametric  point  in  a parameter  space 
(N) 

Z , which  belongs  to  the  Euclidean  N-space.  In  the  present  paper  a 

sample,  s,  of  size  n,  1 < n < N,  designates  a subvector  of  x.T 
~ — — ~N 

consisting  of  n components  s = < x.  ,...,x.  >,  where 

1 n 

ij  e [l,2,...,N]  for  all  j = 1,...,N.  A sampling  procedure  is  a plan 
according  to  which  the  components  of  x^  are  chosen.  In  a non-Bayesian 
theory  of  sampling  surveys  one  has  to  introduce  probability  functions 


P(s)  on  the  sample  space,  J.,  of  all  possible  samples,  in  order  to 
discuss  random  samples.  In  a Bayesian  theory  the  parametric  vector 
Xjj  is  considered  a random  vector  having  a prior  joint  distribution 


H(xm)  on  According  to  this  approach,  the  population  vector. 


Xjj,  is  a realization  of  a sample  from  a "superpopulation",  generated 
(like  in  a Monte  Carlo  procedure)  according  to  HCx^).  According  to 


this  approach,  given  any  sample  s = < x.  ,...,x.  >,  the  joint  prior 

X1  1n 


distribution  of  s can  be  derived  from  H(x^)  and  the  posterior  joint 
distribution  of  x*_n  = < x^;  v i s>  and  is  independent  of  the  sampling 
probability  function  P(s),  which  is  immaterial  for  a Bayesian  analysis 
(see  Solomon  and  Zacks  (1970)).  For  this  reason  we  will  assume  in  what 
follows,  without  loss  of  generality,  that  the  sample  consists  of  the 
subvector  £n  = (x^ . . . ,xn)  and  *J_n  = (*n+1,*  ••  ,Xj).  ^ V*,XH 

are  assumed  to  be  priorly  independent  and  identically  distributed  then 
any  sample  s can  be  considered  a simple  random  sample  from  H,  as 
in  the  classical  model  of  inference. 

The  estimation  problem  is  that  of  estimating  a specified  parametric 
function  0 (^Sn ) population  vector  ( e.g.  the  population  mean, 

variance,  etc. ). 


3.  Estimators  of  the  Population  Variance. 
3.1  General  Structure. 


_ p 

Let  xQ  = (x1,...,xn)  be  an  observed  sample.  Designate  by  xfl,  a* 
the  sample  mean  and  the  sample  variance,  respectively;  where 


If 


- 2 
and  t 

N-n 


designate  the  mean  and  variance  of  the  N-n  units 


*N-n 

not  in  the  sample  then  the  population  variance  is 


e-1)  »"<*>  - 5 • t + ft- + 1 & - ff><vvn)£ 


Formula  (3-1)  can  be  verified  since  total  variance  may  be  written  as 
the  average  of  the  conditional  variances  plus  the  variance  of  the  condi- 
tional' expectations. 

Estimators  of  the  population  variance  are  sample  statistics  with  range 

in  (0,oo).  The  most  common,  estimators  in  use  are  the  sample  variance 

a2  or  the  "unbiased  estimator"  a-2  = a2.  I Formula  (3-1) 

n n n-1  n | 

shows. that,  regardless  of  the  sampling  procedure,  a proper  estimator  of 
<t  (Xjj)  can  be  obtained  by  substituting  estimators  of  ^ and  5c^  n in 

A 2 

(3*1).  The  "unbiased"  estimator  a can  be  obtained  from  (3.l)  by 

substituting  ic*  = x and  t2  = . a2  . .As  will  be  shown 

U-n  n Nrn  n-1  N-1  n 

2 

in  Section  4,  Bayes  estimators  of  a (x^)  can  be  obtained 

O ^ 

by  substituting  corresponding  Bayes  estimators  for  t4"  and  x* 

N-n  N-n 

in  (3.1). 


3.2  Equi variant  Estimators. 

Following  Fraser  [4]  we  will  denote  by  [a,P],  with  -co  < a < » 

and  P ^ 0,  a real  affine  transformation,  i.e.  [a,p]x  = a+fSx.  Let  £ 

denote  the  group  of  all  such  transformations.  We  define  [a,p]xN=(y1, . . . ,yN), 

where  y^=  i=l,...,N.  Every  element  of  transforms  into 

in  a 1:1  fashion.  Let  be  the  group  of  transformations  on  the  parameter 
2 

space  of  o-  (xN)  induced  by  the  elements  of  Jr.  That  is,  if 


6 


i ; 


[0('p]£n  = Xn  then  = P2a^(x^)  where  is  the  element  of^  corres- 

2 

ponding  to  [a,P]  of  G.  An  estimator  cr  (xn)  is  called  equi variant 
Kith  respect  to  G if,  for  every  [a,P]  e $■ 


(5.2) 


a2([a,p]xn)  = P2a2(xn)  , xn  € I 


The  sample  variance  a2  is  equi  variant  with  respect  to  j£.  The 
statistic 


(n) 


r n li 

Jin  = ’ —]Z 


tr  cr 
n n 


~n 


is  maximal  invariant  with  respect  to  Ji{.  Thus,  every  equi var i ant  estimator 
2 

of  cr  (3^)  can  be  expressed  in  the  form 


(5.5) 


> 


Where  i|r(un)  is  a proper  positive  function  of  the  maximal  invariant 

statistic  u . For  further  reading  on  invariance  structures  for 
Ml 

sampling  from  finite  populations  see  Chaudhuri  [3]. 


4.  Bayes  and  Bayes  Equi variant  Estimators. 

4.1  Bayes  Estimators. 

Let  H^)  be  a prior  distribution  in  a specified  family  ft . Let 

2 2 2 

L(fr  ,cr  ) denote  a loss  function  associated  with  estimating  cr  (x^)  by 

cr2^).  An  estimator  ct2^)  is  Bayes  with  respect  to  H^)  and 

a2  2 

L(a  ,cr  ) if  it  minimizes  the  prior  risk  function 


(4.1) 


R(*2'H)  " t[(N)  L(&2(~n)»a2(^N))dH(^N) 


7 


The  following  is  a general  result  for  the  squared-error  loss 
function: 

If  x.^, are  i.i.d.  random  variables  having  any  prior 

p 

distribution  H(x)  with  a finite  prior  variance,  Oq,  then  the 

p 

Bayes  estimator  of  cr  (x^)  is 


(*.2) 


A2  n A2  , nu  2 , n x2n 

°B  N °n  ^ " N a*  N Xn”^0  * > 


2 2 1 

■vdiere  cr*  = 0q(1  - -)  and  ^ is  the  prior  expectation. 

The  proof  of  (4.2)  proceeds  as  follows.  The  Bayes  estimator  of 

2 

CT  given  xn,  for  the  squared-error  loss  function  is  the  posterior 

expectation  of  (5.1).  Furthermore,  since  the  components  of  x^  are 
priorly  independent 


(4.3) 


VvA’ - Vv„>  - W'o  < 


for  any  prior  distribution  H,  having  variance  ct^.  tforeover. 


(4.4) 


V ^Xn_XN-n^  W ~ ^n'^  +' lSn  * 


Substituting  these  expressions  in  (3.l)  one  obtains  (4.2).  In 
many  situations  it  is  not  unreasonable  to  assume  that  x^, . ..,xN  are 
priorly  i.i.d.  Hence,  formula  (4.2)  is  a very  general  formula,  since 
it  does  not  depend  on  the  form  of  H(x),  but  only  on  the  prior  mean 
and  variance.  These  values  may  be  known  from  previous  experience. 


8 


4.2  Bayes  Equivariant  Estimators. 

Consider  the  structure  of  Bayes  equivariant  estimators.  We  have 


* _ r n li  * 

~ £ ~N-n  ' 

n n 

where  = (xn+1> ...jX^)  and  u is  maximal  invariant’ with  respect  to 

al  2 * 

Mi  Let  v,T  and  be  the  mean  and  the  variance  of  u.T  . One  can 

™ N-n  N-n  ~N-rn 

express  the  population  variance  -in  :fchese  terms  in  the  form 


(4.‘5) 


\ A2rii  /«  H\  ✓ ^ • n 2 

17  f2MJ  " °n  N + (1  - K WN-n  + if  W1 


n 2 


3hus,  comparing  (5.3)  and  (4.  5),  the  ijr -function  of  an  equivariant 
estimator  should  be  chosen  to  estimate  the  function 


(4.6) 


..  _/  2 2 » n , ,n  nw  2 n 2 . 

D^WN-n,VN-n^  - N ^ “ N^wN-n  N vN-n^ 


Let  L(i|r,D)  be  a loss  function  for  the  estimation  of  D(w^  v^  ) bv 

v N-n'  N-ny  y 

^Jin)  f . L'M)  is  invariant  with  respect  to  H . Let  G(u  ,u*  ) be 

'~ntTN_n/ 

a prior  distribution  induced  by  H^).  The  prior  risk  associated  with 
f and  G is 


(4.7) 


hC)  * Jt(*(iin)’D(Vn’vL,)aGfVS1l.„) 


An  estimator  O"^^)  is  called  Bayes  equivariant  if  i|rQ  minimizes  (4.7). 
Notice  that  the  criterion  of  minimizing  (4.7)  is  the  same  as  minimizing 

A 2 A p 2 

the  Bayes  risk  for  the  quadratic  loss  L(6,ctn)  = (e-cr^)  /&n>  where 


9 


In  many  applications  it  would  be  reasonable  to  assume  that  the  family 
of  prior  distributions  is  a family  with  location  and  scale  parameters.  In 
other  words>  assume  that  all  the  prior  distributions  of  “'H'  aue  of  the  form 


' <t  ^ rr 


) , 


where  -oo  < < oo  and  0 < aQ  < oo.  In  this  case  the  Bayes  equi variant 

estimator  depends  only  on  the  general  form  of  H^,  . . . ,x^) . Indeed,  the 
distribution  G(un,u^  n)  is  the  same  for  all  ^ and  aQ  of  distributions 

in 

Equivariant  estimators  in  the  strict  sense  were  defined  as  those  of 
A p A 2 

the  form  o-^r(un).  The  Bayes  estimator  crB  (h.2)  is  thus  not  strictly 
equivariant.  However,  if  x^  is  transformed  to  [a,p]xN  the  prior 
parameters  (Mq^q)  should  be  transformed  to  = (a+PMo»  l0^* 


. A A P 

Let  o-/  \(x  ) denote  the  Bayes  estimator  cr_  with  the  prior  parameters 

(VV  ~n  a2 


Pq  and  CTq,  respectively.  Then  a ^ ^ j(xn)  is  generalized  equivariant  in 

the  sense  that 


(4.8) 


/v2 

a 


L / \([ot,P]x  ) = \(x  ) > 

La#PJ  ~n  (fvV  ~n 


for  all  -*»  < 0£  < co,  0 < & < <»;  and  all  x^.  Furthermore,  the  Bayes 
A 2 

estimator  a,  \ (x  ) is  also  Bayes  in  the  class  of  all  generalized 

^ 0 ~ .A  2 s2  /a4 

equivariant  estimators  with  respect  to  the  quadratic  loss  (G-cr^)  /c rQ. 


10 


4.3  Examples  of  Bayes  Equi variant  Ksti malors . 

4.3.1  Normal  Priors. 

Suppose  that  x^..,,^  are  priorly  independent  and  identically 

distributed  (i.i.d.  ) normal  variables  with  pri^T-  mean  pQ  and  prior 

variance  aQ.  consists  of  all  such  distributions  with  -00  < < 00 

and  0 < cm  < co  . Under  this  model  the  sample  statistics  x and  a2 

0 n n 

are  independent  of  t and  x,*  . The  Bayes  equi variant  estimation  is 

N-n  Ttf-n 


(4.9) 


^BE  (Sn}  = + + I E{vN-JjJn): 


? 

We  now  show  that  wTT  and  vTr  are  independent  of  u . Indeed,  by 
N-n  N-n  ~n  7 

the  Bayes  model  xn  and  x^  ^ are  independent.  Hence 

independent  of  x^  . Furthermore,  (x^,  cx^)  a comP4e4e  sufficient 

statistic  for  the  subfamily  of  prior  distributions  of  xn»  Hence,  from 

Basu’ s theorem  (Basu,  [ 1 ] ) un  is  independent  of  (x*  n,xn’^n)*  Finally, 

since  u*r  is  a function  of  (x*  ,x  ,cr  ),  u and  u*,  are  inde- 

~N-n  v~N-n7  n7  n 7 ~n  ~N-n 

pendent.  Hence, 


(4.10)  E{w2  | u ) = E{ wf  } = ~ • 
v ' N-n'~n  N-n  N-n 


N-n-1 

n-1 


E(F[N-n-l,n-l] ; 


n . N-n-1 
n-3  N-n 


Similarly, 


11 


. ' 


(4.11) 


E( v |u  } 
N-n'~n 


E{Vn>  = 


Substituting  these  results  in  (^.9)  we  obtain  as  the  Bayes  equi variant 
estimator 


(4.12) 


a2  . . 

cr  (x  ) = 
BEv~n7 


-n'1  - * & 


2 

which,  in  large  populations  is  close  to  En  (x--x)  /(n-3). 

i-1  1 

It  is  well  known  (see  Zacks  [17;  pp.  346])  that  the  minimum  mean- 

2 

squared-error  equivariant  estimator  of  in  the  i.i.d.  case  is 

u 


n q 

^'i-l  (xi_x)^/ (n+l )•  ^ 4he  other  hand,  if  the  loss  function  is  the 

,A  2x?,a4 

quadratic  loss  (0-Oq  ) / the  best  equivariant  estimator  is 
n 2 

Ef  i (x^-x)  /(n-3).  This  confirms  the  above  result. 


4.3.2  Exponential  Priors 

Suppose  that  x-|,...,x^  are  priorly  i.i.d.,  with  a common  exponen- 

2 2 

tial  distribution,  with  mean  p^  (the  prior  variance  is  = p^).  It 
is  shown  in  [l6]  that  the  Bayes  equivariant  estimator  is 


(4.13) 


*2,n  , /,  n% 
17  BE  “ °"n  N ^ " N 


f2  (u  )n2 

TK^irbr }+ 0(n} 


where  f (u^ ) -min(u^, . . . ,u^ )•  Thus,  in  contrast  to  the  normal  case, 

in  the  exponential  priors  model  the  Bayes  equivarifint  estimator  depends 

on  u too. 

~n 


IP 


5*  Bayes  Risk  Efficiency. 


In  the  present  section  we  introduce  an  index  of  Bayesian  efficiency 
2 

of  estimators  of  Given  a prior  distribution,  H(x^),  we  denote  by 

R(ct2,H)  the  -prior  risk  function  of  an  estimator  under  H.  In  the 

present  section  we  consider  squared-error  loss,  (cr  -<r^)  > only. 
Generalization  to  quadratic  loss  functions  can  be  readily  attained. 

A P 

Since  the  minimal  prior  risk  is  attained  by  the  Bayes  estimator 

i3 

2 

with  proper  prior  parameters  Oq,  we  define  the  prior 

aP 

relative  efficiency  of  an  estimator  a~  as 

a2  h(€h) 

(5-1)  KE(ff  ,H)  = § . 

R(o  ,H) 

For  any  estimator,  0 < RE(or  ,H)  < 1. 

5.1  Exponential  Priors-Example. 

We  provide  now  a numerical  example  of  estimating  the  variance  of 

a small  population,  N = 100,  when  the  population  variates  are  priorly 

i.i.d.  exponential  random  variables  with  expectation  n = 10.  The  sample 

size  is  n = 10.  In  Table  1 we  present  the  values  of  the  classical  and 

the  Bayes  estimators  determined  by  50  independent  simulation  runs.  In 

2 

each  case  we  give  also  the  value  of  o^.  We  see  that  generally  the 
Bayes  estimator  is  closer  to  the  population  variance.  The  prior  relative 
efficiency  of  against  is  estimated  to  be  RE  = .122.  Note  R(cr^) 

A ^ O 

and  R(o\  ) are  the  sample  estimates  of  the  prior  mean-squared-errors 
B 
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Eh(  ((J^-CTjr)2}  and  (crg-a^D,  respectively.  We  see  in  this  example 

that  the  classical  sample  variance  is  very  inefficient  compared  to  the 
Bayes  estimator.  In  the  following  example  we  show  some  analytical 
comparisons  for  the  normal  case. 

5.2  Normal  Priors. 

The  prior  relative  efficiency  index  (5-1 ) can  be  expressed  also 
in  the  form 


^ 2 \2i 


(5.2) 


v f , a2  a 2 2, 

o K l (0  -a  ) J _x 

RE  (c^,H ) = tl  + ^ B ‘ 


F^lPVRj 


a 2 


where  PVR  is  the  posterior  variance  of  the  Bayes  estimator  ct  . In 


2^ 


the  case  of  prior  i.i.d.  normal  (n  , on)  variables,  one  obtai 


2a, 


O’  O' 

4 


ns 


(5-3) 


E{PVR(H,xn)}  = -jp  (l-f)(l -|(l-f))  , 


whgre  f ~ n/N.  Consider  the  sample  variance  6^.  Due  to  the  prior 


independence  of  and  cr^  we  obtain 


(5.1,)  EU^  - gif  - (i-5)Io-oft4>+!  > 


- (l-f)acj5  E([f  xjtn-ll-(l -|)-|  J^tll]2)  , 


c P 

where  X^[n-1]  and  X^[.l  1 designate  independent  chi -squared  r.v. 's. 

2 

From  (3-3)  and  (5.4),  the  prior  relative  efficiency  of  a , relative 
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J rA  LANQ  t^OO  ON 


Table  1.  'jO  Independent  Simulation  Runs  of  Exponential  Populations 
of  Size  N = 100.  Variance  Estimates  are  Based  on  Sample 
of  Size  n = 10. 


i 

A2/-  1 
all) 
nv  ' 

A2  /.  \ 
aB  1 

°B(i) 

1 

11.0279 

91.3822 

59*3401 

2 

25.9047 

93.5385 

99.7939 

3 

163.1974 

108. 4712 

117.9033 

4 

114.8876 

102.4455 

112.7694 

$ 

48. 5473 

96.1006 

140.4537 

6 

7 

24.1673 

233.9413 

92.6005 

115.0390 

95-3784 

IIO.2580 

a,a2, 
R(a  ) 

8 

24.2149 

92.8096 

73.1228 

' n 

9 

36.0928 

93.7894 

88. 0842 

0 

58.1589 

95.8768 

92.6123 

1 

82.4155 

98.2541 

IOO.8301 

Av  A O 

2 

110.1057 

101.4153 

82.7390 

R(S 

3 

30.7288 

94.2891 

82.7665 

L) 

4 

92.7353 

99-3392 

66.7146 

5 

14 . 1656 

92.9971 

100.5615 

6 

30.6368 

93.1324 

87.0248 

.O 

7 

75.4294 

97.7225 

74.1037 

RE (a;, 

8 

123.1242 

102.9664 

104.8201 

n 

9 

34.9740 

95.1125 

86.4942 

0 

226.5559 

H6.6118 

118.4538 

1 

16.9147 

92.2562 

134.9088 

2 

98.5459 

100.9711 

72.2479 

3 

48.8585 

94.9472 

134.9985 

4 

54.3939 

95.4909 

114 . 8043 

5 

52.1598 

95.2457 

158.8236 

6 

55-5302 

95.6501 

79.0303 

A, 

7 

8 

171.1030 

107.1958 

87.0796 

105.0818 

100.6807 

128.0554 

9 

17.5409 

92.9367 

95.6511 

0 

23.1610 

93.2519 

94.2407 

1 

116.6341 

101.8029 

118.2461 

2 

27.0976 

94.1436 

74.1948 

3 

69. 4l8l 

98.1458 

101.3439 

4 

20.7325 

93.0247 

98.1585 

5 

191.2959 

112.5688 

121.5687 

6 

199. 9331 

110.6755 

105.3757 

7 

83.3185 

98. 5574 

67.8614 

8 

17.2250 

95.0543 

77.5798 

9 

218.7134 

112.1939 

108. 5281 

10 

30.0034 

95-1121 

85.3298 

u 

34.1185 

93.4987 

80.7266 

>2 

32.7168 

93.6423 

106.1845 

>3 

50.9459 

95.3254 

77.0860 

i4 

41.4210 

94 . 8028 

64.211? 

>5 

36.6681 

94.1386 

75.0202 

16 

22.9323 

93 . 6664 

88.6936 

>7 

41.4523 

94.1452 

64.5216 

>8 

149.5766 

I06.0161 

99.7121 

>9 

A 

19.2172 

101 . 9416 

79.8605 

3887.67 


47U.90 


i)  = .122: 


to  the  prior  normal  distributions  is: 


(5-5) 


RE(VH) 


N(i-r)r~ 


- 


(i 


wr 


»(1  ~ |d-f)) 


The  relative  efficiency  function  is  independent  of  the  prior 
parameters,  since  ctq  is  a scale  parameter  of  the  distribution.  We 
therefore  provide  in  the  following  table  some  relative  efficiency  values 
as  functions  of  the  sample  fraction  f and  the  population  size,  N. 


Table  2 . The  Prior  Relative  Efficiency  of  ct^. 


N\f 

0.10 

0.25 

0.50 

0. 75 

100. 

0.114 

0.310 

0.666 

0.921 

200. 

0.112 

0.309 

0.666 

0.922 

300. 

0.111 

0.308 

0. 666 

O.922 

400. 

0.111 

0.308 

0.666 

0.922 

500. 

0.111 

0.308 

0.666 

O.923 

600. 

o.m 

0.308 

0.666 

0.925 

700. 

0.111 

0.308 

0.667 

0.923 

800. 

0.110 

0.308 

0.667 

0.923 

900. 

0.110 

0.308 

0. 667 

0.923 

1000. 

0.110 

0.308 

0.667 

0.923 

a° 

From  Table  2 the  prior  relative  efficiency  of  <rn  is  almost  independent  of 

% 

the  population  size  N and  is  somewhat  greater  than  the  sample  fraction, 
f.  These  numerical  results  show  the  extent  of  possible  improvement  in 
estimation  if  good  information  is  available  on  the  prior  distribution. 
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In  order  to  analyze  the  extent  of  errors  in  the  prior  assumptions  concerning 


the  values  of  pQ  and  we  derive,  on  the  basin  of  (%?),  the  prior 

aP 

relative  efficiencies  of  cr  (x  ),  under  (p.,ov  ).  It  is  a straight- 

p , cr,  v~n  3 ' 0 0 

A p 

forward  matter  to  show  that  the  prior  relative  efficiency  of  a (x  ) 

• ^l,crl 


(5.6) 


N (l-f )[  (p-l+ffi  ) +4f  ~]  -l 

n 1 


RE  (a  I I)  = [1  ♦ - 


2 2 

where  p = 0^/0^  and  & = (p1-p0)/ct(). 

In  Table  3 we  present  the  prior  relative  efficiency  of  the  Bayes  estimator 
o^,  (xn)  as  a function  of  f,  & and  \=p-l,  where  H'  is  the  N(p1#cr^)  distribution. 
We  see  that  the  magnitude  of  & is  not  so  important,  but  deviations  from  cr0 
larger  in  magnitude  than  10  percent  reduce  the  prior  relative  efficiency 
below  that  of  cr^.  In  Table  4-  we  provide  these  prior  relative  efficiency 
values  for  values  of  \ between  -7.5$  to  7.5$  . We  see  that  in  this 
range  the  Bayes  estimator  is  considerably  more  efficient  than  the  classical 


sample  variance. 


able  3*  The  Prior  Relative  Efficiency  of  ajp  (x  ),  N-  1,000 


Sample  Fraction 

- .10 

tvX 

-.30 

-.20 

-.10 

0.0  0 

0.10 

0.20 

0.30 

-.50 

0.028 

O.O67 

0.279 

0.75'’ 

0.124 

0.042 

0.021 

-.40 

0.027 

0.06l 

0.238 

0.874 

0.l4l 

0.045 

0.022 

-.30 

0.026 

0.057 

0.211 

O.95O 

0.157 

0.048 

0.023 

-.20 

0.025 

0.055 

0.194 

0.986 

0.170 

0.051 

0.023 

-.10 

0.024 

0.053 

O.I85 

O.998 

0.179 

0.052 

0.024 

.00 

0.024 

0.053 

0.182 

1.000 

0.182 

0.053 

0.024 

0.10 

0.024 

0.053 

0.135 

0.998 

0.179 

0.052 

0.024 

0.20 

0.025 

0.055 

0.194 

0. 986 

0.170 

0.051 

0.025 

0.30 

0.026 

0.057 

0.211 

0.950 

0.157 

0.048 

0.023 

0.40 

0.027 

O.Ool 

0.258 

0.874 

o.i4i 

0.045 

0.022 

0.50 

0.028 

O.O67 

0.279 

0.754 

0.124 

0.042 

0.021 

Sample  Fraction 

.25 

t\x 

-.30 

-.20 

-.10 

0.00 

0.10 

0.20 

0.30 

-.50 

0.045 

0.122 

0.617 

0.391 

0.091 

0.037 

0.020 

-.40 

0.038 

0.094 

0.415 

0.602 

0.119 

0.044 

0.023 

-.30 

0.033 

0.078 

0.304 

0.817 

0.150 

0.051 

0.025 

-.20 

0.031 

O.O69 

0.247 

0.950 

0.180 

0.057 

0.027 

-.10 

0.029 

0.064 

0.219 

0.994 

0.202 

0. 061 

0.028 

.00 

0.029 

0.062 

0.210 

3.000 

0.210 

0.069 

0.029 

0.10 

O.029 

0.064 

0.219 

0.  994 

0.202 

0.061 

0.028 

0.20 

0.031 

0.069 

0.247 

0.950 

O.I80 

0.057 

0.027 

0.30 

0.033 

0.078 

0.504 

0.817 

0.150 

0.051 

0.025 

0.40 

0.038 

0.094 

0.415 

0.600 

0.119 

0.044 

0.025 

0.50 

0.045 

0.122 

0.617 

0.591 

0.091 

0.057 

0.020 

Sample  Fraction 

.50 

6\X 

-.30 

-.20 

-.10 

0.00 

0.10 

0.20 

0.30 

-.50 

0.114 

0.393 

0.780 

0.199 

0.073 

0.056 

0.022 

-.40 

0.076 

0.214 

0.847 

0.373 

0.109 

O.C48 

0.027 

-.30 

0.058 

0.142 

0.555 

0.643 

0.159 

0.062 

0.032 

-.20 

0.048 

0.110 

0.382 

0. 893 

0.216 

0.076 

0.058 

-.10 

0.044 

0.095 

0.307 

0.989 

O.  266 

0.087 

0.04l 

.00 

0.043 

0.091 

0.286 

l.<  - 

0.286 

0.091 

0.043 

0.10 

0.044 

O.O95 

0.307 

0. 989 

0.2(  i6 

0.087 

0.041 

0.20 

0.048 

0.110 

0.382 

0.850 

0.016 

0.076 

0.058 

0.30 

0.058 

0.142 

0.555 

0.645 

0,159 

0.062 

0.052 

0.40 

0.076 

0.214 

0.847 

0.57  3 

0.309 

0.048 

0.027 

0.50 

0.114 

0.395 

0.780 

0. 3 99 

0.073 

0.056 

0.092 

Table  4.  Prior  Relative  Efficiency  of  (x  ) , N= 1,000. 


Sample  Fraction  - .10 


&\x. 

-.075 

-.050 

-.025 

0.000 

0.025 

0.050 

0.075 

-.50 

0.461 

0.754 

0.957 

0.754 

o.46i 

0.279 

0.180 

-.40 

0.385 

0.645 

0.939 

0.874 

0.560 

0.334 

0.210 

-.30 

0.336 

0.564 

0.884 

0.950 

0.651 

0.387 

0.258 

-.20 

0.305 

0.510 

0.829 

0.986 

0.722 

0.431 

0.262 

-.10 

0.288 

0.480 

0.793 

0.998 

0.766 

0.460 

0.278 

-.00 

0.283 

0.470 

0. 780 

1.000 

0.780 

0. 470 

0.285 

0.10 

0.288 

0.480 

0.793 

0.998 

0.766 

0.460 

0.278 

0.20 

0.305 

0. 510 

0.829 

0.986 

0.722 

0.431 

0.262 

0.30 

0.336 

0.564 

0.884 

0.950 

0.651 

0.387 

0.238 

o.4o 

0.385 

0.645 

O.959 

0.874 

0.560 

0.354 

0.210 

0.50 

o.46i 

0.754 

0.957 

0.754 

0.461 

0.279 

0.l80 

Sample  Fraction 

.25 

&\x. 

-.075 

-.030 

-.025 

0.000 

0.023 

0.050 

0.075 

-.50 

0.868 

0. 868 

0.617 

0.591 

0.252 

0.171 

0.122 

-.4o 

0.658 

0.911 

0.874 

0.602 

0.378 

0.244 

0.166 

-.30 

0.484 

0.759 

0.965 

0.817 

0.532 

0.333 

0.217 

-.20 

0.385 

0.619 

0.910 

0.950 

0.678 

0.423 

0.268 

-.10 

0.336 

0.540 

0.858 

0.994 

0.777 

0.491 

0.307 

-.00 

0.321 

0.516 

0.810 

1.000 

0.810 

0.516 

0.321 

0.10 

0.336 

0.540 

0.888 

0.994 

0.777 

0.491 

0.307 

0.20 

0.385 

0.619 

0.910 

0.950 

0.678 

0.423 

0.268 

0.30 

0.484 

0.759 

0.965 

0.C17 

0.523 

0.333 

0.217 

0.40 

0.658 

0.911 

0.874 

0.602 

0.378 

0.244 

0.166 

0.50 

0.868 

0.868 

0.617 

0.591 

0.252 

0.171 

0.122 

Sample  Fraction  - 

• 50 

-075 

-.050 

0.025 

0.000 

0.025 

0.050 

0.075 

-.50 

0.571 

0.395 

0.276 

0.199 

0.148 

0.114 

0.090 

-.40 

0.921 

O.766 

0.544 

0.373 

0.861 

0.188 

0.l4l 

-.30 

0.787 

0.951 

0.875 

0.645 

0.440 

0.303 

0.21 5 

-.20 

0.573 

0.805 

0. 974 

0.895 

0.655 

0.445 

0.305 

-.10 

0.448 

0.662 

0.905 

0.980 

0.815 

0.568 

0.384 

-.•00 

0.415 

0.615 

0. 865 

1.000 

0.863 

0.615 

0.415 

0.10 

0.448 

0.662 

0.905 

0. 989 

0.815 

0.568 

0.384 

0.20 

0.563 

0.805 

0.  974 

0.895 

0.633 

0.445 

O.305 

0.30 

0.787 

0.951 

0.875 

0.645 

o.44o 

0.503 

0.214 

0.4o 

0.921 

O.766 

0.  544 

0.575 

0.261 

0.188 

O.lhl 

0.50 

0.571 

0.395 

0.276 

0.199 

0. 148 

0.114 

0.090 
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